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THE USE'oF teaching PERFOR>tAK^$E TESTS TO , ASSESS THE ABILITY OF 
PROSPECTIVE TEACHERS TO RELATE LOV^R-ORDER .LEARNINGS IN PBTE PROGjlAMS 

♦ 

PBTE programs are based 'on the idea that teaching can be' broken dovm 
into a larg^ number of small parts and that reinforcement can. he' made ^coj^- ' 
tingent upon the successfv^l performance of ,each part. Behaviorists would 
descrihe such an arrangement Of contingencies of re'inforc^Hient as a fixed 
low-»ratio scla^dule^of reinforcement. Research indicates that this schedule 
of reinforcement is less .effective in. building response strength and .main- 
taining it oyer lorig^time periods tl^an a variable high rati^ schedule of ~ 
^ reinforcement (Skinner, 1968) . In ^order to have a^ vaj'iable high-ratio 
schedule* of reinforcement , criterion measures must.be found to asses^ t^tie^^ 
terminal behavior cTf th§ entire program, and make fi,nal reinf^^rtf^ent con- 
tingent upon the miniraur'. successful performance of that behavior. Such a 
procedure jJOuW require that* prospective ,teachers\integrate all lowejr-order 
learnings included in the entire program, and perforn these properly rela- 

• ' , ' • i 

tive to one- another . Lower-order learnings in this tWo dimensional schedule 

of reinforcement would be on a fi7:ed' Iciw-ratio schedule while the integration 

of^>p-arts would be on a variable high-ratio schedule of reinforcement. High- 

ratio because final reinforcement is delayed until all parts are performed, 
♦ / . ^ 

and'vardable because reinforcement reinains in doubt until mii^imum successful 
performance standards are achieved. ' ., . ' 



.. 1 . Problem * i ' 

-• • ' • _ • — _ .... 

Teaching performance tests have been used in' a variety of ways as 
asses^jpent and improvement instrunents. McNeil dnd Popham haVe summarised 
their uses ^as assessment instrunents in contract plaris^ and to collect 



, Information about the instruf tionaKeff etti venfe^ss' of individual teachers 
.^^McNeil .and Popham, 1973)^>1ptre/recently Popham has described yariou^ ways 
in which pprFol-mance^^fe'nitght h.e used to improve the Rerformance- of " 
preservice and injj^^ice t&achers (Pophram, 1975). These include using ; 
perfpnaaace tests^to focus teaches' attention on. pupil outcomes; to pro-^^ 
. vide teachers with feedback as to the effects of tlieir teacher behavior on 
,^ pupil 'outcomes; and as a {urogram evaluation assessment>*technique . Research 
has not been reported, howevfer, on the usefulness of teaching performance ^ 
tests to direct and energize the behavior of pro^pect^ive teachers in PBTE 
programs. .In this approach to the use of teaching performance tests an 
_ assumption is made that behavior is largely activated by a^icipation of 
reinforcing- consequences (Bandura and Perloff, 1967). Motivation of learning 
is l-argely regulated through various arrangements of contingencies of rein- 
forcement. In order to get prospective teachers to relate lower-order 

learnings included in the overall PRTE program, and to perform these properly 

\ ^ J 

relative to one another an arrangement of "contingencies of reinforcement 
must be developed which would withhold final reinforcement until integrative 
behavior is demonstrated. . * " ' ^ 



Objective ' - ' ' ' 

The objective of this i^esearc^^ w^s to use teaching performance tests 
* to transform an existing >^fixed low-ratio schedule reinforcement in a 
FjBTl; ''program into a variable high-ratio schedule of * rei;^f or cement . The 
setting was' that of a PBT€ program in w)iich teacher behavior h^d been brokefT 
down into parts 'each of which had been stated as a behaviorjal objective, 
and a treatment developed which would enable prpspectiva^^achers to a\ta^fi - 
this objective. In order to be permitt;ed to begin his stucient t;p^«f€hing^ 
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asfiflgnment on time the student mu,st attain* all pre-student 'teachings obiecf^ 
, ives prion to the beginning date of his student teaching assig^ietltT Teach- 
ing performance* tests were introduced into this program as a final objective 
to be attained Jy^rior to student teaching. In the fixed fovPratip^cfi^le 
tDf reinforcement treatment students merely completed the teaching performanc 
test^ prior to student teaching- In the variable hijh-ratio schedule of 
reinforcement treatment students had jtp attain a prespecif ied class perfpfm- 
ance level stalled in tT\e teaching *iier,'formance test ob^^'c^tive prior to • 

^ student teaching. This lattef^^poiXKiedure enabled us ta.g-ive reinforcement 

''''' 

4or each of the ^Iraall 'parts included in tha'gjg^^p, and in addition delayed 

' ► * , . .^^^"^ 

final reinfor.cement over the entire lengtl^tif th^ program until students 

were able to integrate the parts and thereby achieve^^p^f ormance standards. 

The treatments were hypothesized to ]?e related to d^pend^nt measures of 

teacher effectiveness as, follows: students in a PBTE program in which 

teaching performance tests were used;' as part of -a variable high-ratio 



schedut^^^^^j^^ Vould^scoije hi;gBST^-sn..,,cr^erion Sqeasures of 

:her ef^ilctiven6&B>^an students fin a PBTE program In which t?^ 




performance tests were used' as part of a fixed: low-ratio schedule of 
reinforcement. 



Method 



St^udent teaching assignments 'begin each nine w^ek peripd at ISU over 
the entire academic'^^ear-- The constraints place4 upon the re^search was 
such jthat we were unable to vary teaching perfo-rmance test treatments within 
each nine week pteriod. Consequently, the treatments described below were 
not administereS^to- Jnd^pefndent random samples of subjects* withlp the same 
time-period, but Were administered sequentially to different saijtples of 
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subjects over the 1973-1974 aoademic year. Variance in sairtple si^e. withift^, 
.treatments is .due to the fact that parallel studies were being conducted 
for each nine yeek period and only a portion of students eligible for 
student teaching assignments could be used in this .research. .These" students 
were randomly selected ~£or the treatments described. ' ■ 



SubjecJts 



All subjects (N=201). weVlJlnior or seM^rSlfeT^ive secondary 



teachers drawn from all depart(.ent>^t^. All selects were completing 
their student teaching requiremeiits whith deal with general methods topics, 
microteaching, and a f inai<ipd£kage involving the completion of a teaching 



performance test administered at Universit^gh Laboratory School at ISU. 
This last package was called the Integrative Laboratory Experience (ILE) . 



Procedures 

The ILE treatment was divided into three stages^sumnai 



Figure 1. 




Figure 1 

'ILE Treatment Sunniary (1973-1974) ' 
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Treatment- 
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Construct a teaching performance test 


2 
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Teach, and reteach gelf-constructed teaching 
performance test w ^Measure amount of improve- 
ment from pre to pbi^test . 

■ — -X : 


3 

Assessment 


Compare ^.evel of sJcill-attaintftent against * 
standards 6f non self-constructed-,.,tests 

*, • ■ "x 


1 • ^ 





At stage 1, training, each student was required to read §bout teaching 
performance 'tests (Pophartni^ and Baker, 1972), study a model teaching per- 
formance test (Popham, 1972), and submit an ^t^riginal teaching performance 
test covering material in his subject matter field. „^ffie test Consisted of 
an objective with a prespecified class performance level to be attained, 
cotttent needed to attain the objective, a teaching strategy to be used, and 
two pupil tests (p^tes^ and posttest). At stage 2, practice, each student 
was to teach his ^elf-cons^t^sf^ teaching performance test to a learij^er 
group, and obtain pretest measures of their at titudes and achievement. 
Later he was to reteaph the same lesaorr'fo the same pupils and abstain a 
posttest measure of their^^dTievement. This part of ILE replitates pro- 
" cedures developed at UCLA (Popham, 1972). At st^ge 3, assessment, a 
teaching performance test was administered to each student under (:x)rnparable 
test conditions us:^ng University High Laboratory Scliodl pupils as ie^mer 
groups. The ILE student was given one of nine teaching performance tests 
developed at UCLA .(Popham, 1972). These tests are content neutral as to 
teacher-pupil previous learning, and include cia*s performance levels stated 
in the objective. ^These class performance levels were derived from field 
tests conducted at UCLA and replicated at ISU. These field tes't norms were 
used as criterion measures of* the student^s readiness for student teaching.. 

Data Sourt 

The ILE experiment^was divided into four nine-week phases as shown in 
'Figure 2 below. In each phase the treatm^pt' was varied at stage ,3, assess- 
ment, in order to test the main effect^f using teaching performance tests 
as assessment instruTi^ents . In i>hase 1, admissiion t6 student^ teaching was 
made contingent upon the attainm^t of the p»respecif i'ed class performance 
level stated in the objective of the teaching performance test constructed 
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at^UCLA. Practice in phase 1 was not required.^ In phase 2, a dmission ta. 



N 

student teaching was made contingent upoTl^^tTie student having completed a 
teaching performance test, but '^the attainment 'of the prespecified clas^ . 
performance level was not ^requited. Practice in ph^'se 2 was not required. 
In pha§e 3, ^dmission to stude^nt teaching 'was again made contingent upon^^ 
the completion of a teaching performance t^est without haying to reach a 
^pi;eapecif l^d class ^performance lev^l. However, t)ractice was- required . In 
phase A, students were required to both practice, an^sachieve ^prespecified 
; bla^ss periorm^ce^ levels in order to be allowed to begin stii^i&tT^sj^ching . 



Figure 2 

ILE Experiment Summary (19,:^-1974) j 
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_ The criterion teaching performance tests used were eight of the nine Popham 

test5 included in the Teaching- Improvement Kit, Adult Fbrm (Popham, 1972). 
J In ord^r^^o avoid cantamination from University High School pupils becoming 

; ' 

sensitized to these instruments, it was necessary to rotate their use in ' 
each phase of the e^'per iment . ' During phases 1 and 3, the same four'Popham 
mlnilessons were used hut parallel posttests were, administered by the 
subjects tp their UpHigh pupils. During phases 2 and 4 the remaining four ' 
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Popham minilessons with their parallel pbsttests were used. , In all_ phases^, 
the subjects yere randomly assignee! to the Popham tests and the p'upils * 
(learner-croups)- were/randomly Assigned to each subject. All of the'Popham 
teaching performance tests were assumed to be of comparable difficulty. 
The basic raw scores generated were pupil posttest tneajis for each subject ^ 
on the teaching performance test,, - , • . . 



suits 



Table 1 displays the means for the subjects in the. treatment groups, 
A one-way ANOVA indicated that these means differed significantly at the 
.01 lavel with F=32.78 and ^^(3 , 197)=3 . 88 , The Scheffe S follow-up^ 
procedure was then used to ^^xp^lore the contrasts of interest. When the ^, 
average of phases 1 and^^ (Performance Level Assessed) was Compared yith 
the average of phases v and 3 (Performance Level Not Assessed) an observed 
contrast of 10.71 (i , e \ ' ^9,81%^75 . 20 ^ 50,A9|73,10 ) obtained,. 




Table 1 

Performance of Treatnient Groups 
(lUE- flxperiment 1973-7A) 



Phase 



Tre'^^ment 



S,D, 



Performance Level Assessed-^ 
Practice Not Required 

Performance Level Not As- 
sessed- Practice^ Not Required ' 

Performance Level Not^ -As- ' 
>^se«sed- Practice jRequirdd, 

Performance Level Assessed- 
Practice Required 



42 ^ 69.81 



53 . 50.49 



91 73.10 



15 . 75,20 



14,65 - 



14,19 



13,27 



15.15 




• . • ■ • -8-: 

This result wa^ significant beyond the .01 leVel ir\5^^pr of phases**! and 

*' ' * " ' • 

4 (Performance Level* Assessed^ . phen all pairwise contr-^sts wer6 examined, 

phases 1, 3, and 4 eac^h produced aignif can-tly^higher * , Ql) performance 
means than phase. 2 but did nat differ significantly from one another. Thus 
it may be inferre4 that phase 2 (Perf ortnance Level Not Assessed -Practice 
Not JRequired) accounted for the significant differences between the four 
treatments. Indeed, perhaps tVie most ^tir^iklng feature of IJable 1 is the 
similar p.erformance meana of phases 1, 3, and 4 and their magnitudes as 
coHtparfsd to the 'relatively depressed performance mean af- phase 2. The 
extreme .separation of the piiase 4 arid 2. meajis supports the liypothes.is and 
would b.e expected bepause these t^reatments represent tTie optimal and 
minimal conditions *Qf the^ exper^m^zit . However, the closeness'of the phase ^ 
1 and 3 means to X\i^ .phase 4 mean was somewhat surpris'ing. One possible 

• ' •. ■ ■ ■ • 

e!xplanation df the' closeness of the pha.se 1 and 4 meahs 4.^ that 60% of the 
> subjects in phase 1 voluntarily "practiced with teaching perf ormanc^e - tests 
prior" to assessment (In phase 2 less than 10% voluntarily jpracticed) In 
practice, tlien, the treatment conditions of phase 1 were virtually the same* 
as those pf phase'A* The cldseness of the phase S^^nd ^ means, however, is 
a matter opt^n to speculatioTi. It must be rejnemb<?r^d that'' this finding along 
with tb,^^ other bindings are highly tentative due rhe iimi'tStions of the* 
quasi-experiiritlntal design used in the'study: Perhaps the beS,t that can be 
said^i^s that the results tend to suppojrt out hyp^D thesis and wpuld warrant 
further investigations under more carefuliy controlled circumstances. • 

\ • ' ' C onclusion • 

The strengths of PBTE progrs^me^^^glw out o-f the analysis of teaCher 

behavior irjto a large number of small parts which can stated explicitly,' 
i . ' ' • . ^ 



and arranged iti relation to each otter as contingencies of reiiiforcement , 
The weaknesses thiat arise in such programs is due to the fragmentation 

• among the pkrts Included in the overall program, and in the fixed low- 
ratio schedule af reinforcement which results from the. extreme reductionism 
of sruch programs. Teaching performance tests can be used to correct these 
weaknesses in PBTE programs. Our study indicates that when performance 
tests with prespecifled^ performance levels stated within test objectives 

• are used as ^instruments to assess lower-harder learnings in PBTE programs ^ 
the motivation and learning of students is increased/ Obversely whep 
teaching performance tqsts are linearly arranged'in relation to preceeding^ 
learnings, and not .used' as assessment instruments the motivation arid ^ 

; -r — ^^^^ current conception of teacher 

evaluation is that assessment of teacKfers is useless, and that the "Ifiinction 
of teacher evaluation should be to Kelp t^^hers -develop self-impiroVfement • 
sKills. -In this vie\^ the use , of .teaching ^perft^ance, 'test^^ alpng with ' 
observational systejnsy and rating insti^uments *'>hoi!tld^e limited .to feedhaclc 
not asseSsmeitt-^-ns^u^jmejlts^^T^^ tJiaXa^sessmfent^ w 

improvement is useless, but" t;hat improyemenE^^'wit^i^ ass\^ment .is unreal- - 
istic' Used'^as assessment Ipstrurrtiehts teaching perfor!nam:eN:es^ts can in-, * 
^crease the integrative be^iav^or of prospective "t(^achers; 
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